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On the existence of compact ^-approximated formulations 
for knapsack in the original space 
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Abstract 

We show that there exists a family V of Knapsack polytopes such that for each P gV and 
each e > 0, any e-approximated formulation of P in the original space M” requires a number of 
inequalities that is super-polynomial in n. This answers a question by Bienstock and McClosky 
(2012). We also prove that, for any down-monotone polytope, an e-approximated formulation 
in the original space can be obtained with inequalities using at most 0(i min{log(re/e), n}) 
different coefficients. 


1 Introduction 

The Knapsack problem is one of the classics of combinatorial optimization: given a set of 
n objects, each coming with a nonnegative weight and profit, and a threshold B, find the 
most profitable subset of objects whose total weight does not exceed B. Knapsack has been 
extensively studied in the combinatorial optimization and integer programming communities 
(see e.g. P [E]). 

From an algorithmic point of view, we know that the associated decision problem is NP- 
Complete [5]. On the sunny side, the Knapsack problem admits a fully polynomial-time 
approximation scheme (FPTAS) P [11]. That is, for each e G ]R_|_ and n € N, a feasible 
solution to a Knapsack instance on n objects of cost at least (1 — e) the cost of the optimum 
can be found in time polynomial in 1/e and re. Roughly speaking, this implies that we can 
find an approximated solution with cost arbitrarily close to the one of the optimum, in time 
polynomial in the input size and in the accuracy of the approximation. This algorithm relies 
on classical combinatorial techniques such as scaling, rounding, and dynamic programming. 

A natural question piaiis] is whether we can translate the algorithmic approximation 
given by the FPTAS into a polyhedral approximation, that is, whether we can approximate the 
Knapsack polytope using a polynomial number of inequalities, where the Knapsack polytope 
is the convex hull of all 0 — 1 vectors in M"" corresponding to feasible solutions of a given 
Knapsack instance. Let us formalize the concept of polyhedral approximation by introducing 
some definitions. 

Definition 1. Given a polytope P C M"- and e > t), we say that Q C M"- is an e-approximated 
formulation for P if P ^Q, and for each c G the following inequality holds 

maxjca: : a: G P} > (1 — e) maxjca: : x G Q}. (1) 
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For a polytope Q C M", we denote by size{Q) the number of inequalities in a minimum 
linear description of Q (i.e. the number of facets of Q). We also denote by xc{Q) its extension 
complexity, that is the minimum size of a polytope Q such that there exists a linear map vr 
with Q = Note that Q and Q can have different dimensions. 

A family V of polytopes is said to have a polynomial-size relaxation schemes (PSRS) if 
for each e > 0 there exists a polynomial function </> : N —)• N such that for each P G V with 
P C M”', P has an e-approximated formulation Q with xc{Q) < 4>{n). 

If, in addition, the function (f grows polynomially in then V is said to have a, fully polynomial- 
size relaxation schemes (FPSRS). 

The above definitions (see 0) of PSRS and FPSRS can be seen as a translation of the 
algorithmic notions of FPTAS and PTAS into polyhedral terms. 

For the family of Knapsack polytopes, the existence of a PSRS has been proved by Bien- 
stock [5], while the existence of a FPSRS is still an interesting open question 

The PSRS provided by [2] yields an e-approximated formulation Q with small extension 
complexity, but it does not imply strong bounds on size((5). In fact, in the same paper 
Bienstock [2] , as well as Bienstock and McClosky [3l Question 1, page 340], ask whether such 
result can be straightened by proving the existence of a PSRS in the original space, that is 
given by replacing xc{Q) with size{Q) in the definition of PSRS. In other words, whether for 
any Knapsack polytope P C M"’ we can find an e-approximated formulation Q C with a 
number of facets bounded by a polynomial function 

In this paper, we negatively answer this open question. 

Theorem 1. The family of Knapsack polytopes admits no PSRS in the original space. 

Bienstock and McClosky [3j also ask for upper bounds on the number of inequalities needed 
to obtain an e-approximation in the original space for the Knapsack polytope. To the best of 
our knowledge, the only known upper bound is the one of Van Vyve |14] . cited in [3], of order 
([n/e] -|- I)”. This follows from the fact that the formulation containing all valid inequalities 
with integer coefficients between 0 and [n/e] is e-approximated. In [3], it is also shown that, 
for each 7 > 0, there exist Knapsack polytopes P such that the polytope Q given by all valid 
inequalities with integer coefficients up to n^~'^ is a bad approximation. Namely, there exists 
an objective function c G M+ such that the ratio ([T]) is arbitrarily close to 1 / 2 . 

Our second result is a new upper bound on the number of different coefficients (hence on 
the number of facets) needed to obtain an e-approximated formulation for Knapsack polytopes 
in the original space. Our upper bound improves over the bound in m whenever 1 /e is a 
sub-exponential function of n, and asymptotically matches it otherwise. Moreover, our result 
holds for any down-monotone polytope, that is, any polytope P C Ml/ with the property that 
X G P and 0 < y < x, implies y G P. 

Theorem 2. For any down-monotone polytope P C M”, an e-approximated formulation in the 
original space can be obtained with inequalities using at most 0 (i min{log(n/e), n}) different 
coefficients. Each of those coefficients is an integer between 0 and 5n(l — e)/e. In particular, 
there exists an e-approximated formulation with 0 (i min{log(n/e), n})”' facets. 

We emphasize that Theorem [2] implies the existence of e-approximated formulations of a 
down-monotone polytope with only O(logn) different coefficients, if e is fixed. 


2 No PSRS in the original space exists for Knapsack 

The goal of this section is to prove Theorem [TJ 
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The strategy. For any given e > 0 small enough, we provide an infinite sequence of 
integers, and to each integer n from this sequence we associate a Knapsack polytope -P(n, e) C 
M”' and a family of points X (n, e) C with three properties: 

(i) \X{n,e)\ is super-polynomial in n; 

(ii) for each x G X{n, e), there exists c € M” such that (1 — e)cx > max{cx : x G -P(n, e)}; 

(iii) for each pair of distinct points xi,X 2 G X{n,£), the line segment between xi and X 2 
intersects P{n,e). 

In particular, (ii) implies that P{n,£) H X{n,£) = 0 and, most important, that any s- 
approximation of P{n,£) must have an inequality separating each x G T(n,e) from P{n,£). 
However, (iii) implies that no two points xi,X 2 G X{n,£) can be separated by the same 
inequality, since the line segment between them intersects P{n,£). It follows that any de¬ 
scription of an e-approximation of P{n,£) contains at least \X{n,£)\ distinct inequalities, that 
is super-polynomial in n by (i). As e was arbitrary and the choices of n were infinite, this 
implies Theorem [1] We remark that similar strategies have been recently used by Kaibel and 
Weltge [7] and Kolliopoulos and Moysoglou [TO] . 

Constructing a family of Knapsack polytopes. Let e > 0 be a fixed small number 
< For any n > 1/e, n > 130 that is the square of a prime number, we construct a 
Knapsack polytope as follows: 

n 1 ^ 

P{n -t- 1, e) = {x G {0,1}"+^ : Y] -—-^Xi + nxn+i <n + - - 1}, 

2£Pn l£ 

1=1 

Interestingly, note that P{n + l,e) describes a somewhat “easy” Knapsack instance. In 
fact, the set of feasible solutions can be partitioned into two subsets: those with Xn+i = 1 and 
those with Xn+i = 0. If we fix the value of Xn+i, the residual problem in both cases reduces 
to a Knapsack instance where all the n remaining objects have the same size. Therefore a 
greedy algorithm can be used to find an optimal solution to each subproblem. Similarly, from 
a polyhedral point of view, one easily realizes that the convex hull of the points in P{n + 1,£) 
admits a compact extended formulation. This can be obtained as follows: partition again 
the family of feasible solutions into two sets based on the value of Xn+i- As one immediately 
checks, the convex hnll of each of those two subproblems has a compact formulation. Therefore 
one can apply Balas’ union of polyhedra technique [1] to obtain the claimed compact extended 
formulation. However, the situation drastically change when we require our formulation to 
yield a polytope in In this case, we can not even £-approximate our polytope without 

using a super-polynomial number of inequalities, as we are now going to show. 

Constructing a family of points. Onr goal is to define a family of points X{n + l,e) 
that together with P(n-|-1, e) satisfy properties (i)-(iii). The main idea lies in realizing that this 
can be achieved by constructing a suitable set system S of subsets of [n], containing a super¬ 
polynomial number of sets with the property that the sets have pairwise small intersection. 

A way to construct such a set system is following an idea of Nisan and Wigderson m 
Lemma 2.5]. Consider the field F with ^/n elements, which exists because we are assuming y/n 
to be a prime number. Consider the universe set U made of n elements represented as ordered 
pairs (a, b) with a,b g¥. To each polynomial vr of F of degree at most [vTr/2 —4], we associate 
the set Stt = {(a, 7r(o))}aeF- Note that = y/n. Let S be the family of all such sets. It is 
well-known (see e.g. m) that, for each choice of 2(A:-|-1) elements oi,. .., ak+i,bi,..., bk+i G F, 
with the first k P 1 being distinct, there exists exactly one polynomial tt in F of degree at 
most k such that 7r(aj) = 6* for each i. We then dednce |5| = nzd-AAi/^-T+i) ^nd 15.^- n Stt/] < 
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\_\/nl‘l — 4J for each pair of polynomials tt 7 ^ vr' of F. Hence, we obtained a family 5 C 2"' 
such that: 

(a) |5| = -y/n for each S £ S, 

(b) |5 n S'\ < — 4J for each S ^ S' £ S, 

(c) |5| = n5(L^/2-4l+i). 

From know on, we denote the elements of U with numbers 1 to n, and identify the i—th 
element with the i-th object from the knapsack instance, for i = 1, ... ,n. For each S £ S we 
define a point with coordinates; 

_ ^ 5 ' - 4 

■^n+l 5) 

- xf = 1 — I for i G 5, 

- xf = 0 for i ^ 5 and i 7 ^ n + 1 . 

We let X{n + l,e) be the family of these points, that is X{n + l,e) := {x‘^ : S £ 5}. 


Verifying properties. We now show that X{n + l,e) and P{n + l,e) satisfy properties 
(i), (ii) and (iii), concluding our proof. 

Claim 1. X{n + 1,£) satisfies (i). 

Proof. \X{n + l,e)| = |5| and, by (c), |5| = n2(l-v4i/2-4j+i)^ q 

Claim 2. Al(n + l,e) and P{n + 1,£) satisfy (ii). 


Proof. Fix S £ S, and define c £ M” as follows: 

“ Cfj+l — 1, 

- Cj = 0 for i ^ S' and i n pl. 

We first show that ^ 

max{cx : x £ P{n + 1, e)} = —. 

Let X* be the optimal solution to the problem max{cx : x £ P{n + 1,£)}. Without loss of 
generality, we can assume that the non-zero entries of x* have indices in the set S U {n -|- 1}, 
since all other indices have objective function coefficient equal to zero. 

Let’s first assume that x*_,_]^ = 1. Then 


^CiX- 

ies 




- 2e 


where last inequality is implied by feasibility of x*. It follows that cx* < 

If instead x*_f_^ = 0, we get Q X* < |5| On the other hand. 


e 


1 


1 1 


1 11 


cx^ = (1- )(—) -I— =-1— =-1-, hence 

^ ' tr o.. /I ' tr on’ 


2”2e 


2 e 


2e 20 


(1-e)- 


cx 


/ X/ 11 X /I 11 X 
> (1 - e)(l -I- —e) - 1 -I- e(— - —e) > 1 


max{cx : X G P(n -b 1, e)} ' 

where last inequality follows because ^ > 0, since e < ^ 


□ 


Claim 3. For each S S' £ S, we have ^x'^ + ^x"^^ G P{n -|- l,e). Hence, X{n + l,e) and 
P{n + l,e) satisfy (iii). 
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Proof. In the following, we abbreviate P{n + l,e) by P. Let := + ^x^ . We show 

that x^^' G P by showing that x^^' < x (where the inequality is coordinate-wise) for a vector 
X £ P, that is, x^^' is dominated by a point x inside the Knapsack polytope. Since the 
Knapsack polytope is down-monotone, the claim follows. 

We now describe how to choose x. Let a ;= |5 n S'\ < — 4 and /3 := [(1 — 2e)\/nJ. 

By our choice of n and e, we have /3 — a > 0. Consider the family JC all possible subsets of 
[n + 1] of elements which: 

• contain {n -|- 1} U (5 C S')] 

• contain 13 — a elements from SAS'. 

Note that each of those sets has weight (with respect to our definition of P{n + l,e)) 


n + 



<n + 



-" + Ys- 


1 


hence it is a feasible Knapsack solution. Therefore, the incidence vector of each of those 
Knapsack solutions belongs to P, and we associate to each of them the multiplier | • 
Moreover, consider the set S U S'. This set also induces a feasible solution of P, since the 
total weight of the elements is at most 1/e < n, and therefore its incident vector is a point in 
P. We associate to this incident vector the multiplier 1/5. By construction, those multipliers 
induce a convex combination of points from P, hence a point x £ P. 

We are left with showing that x dominates x^^'. Clearly, for any index i ^ SU S' we have 
Xi = 0 = xf^ . For the index n -|- 1 we have Xn+i = = 4/5. For indices i G S' n S' we 

have Xj = 1 > (1 — |) = xf^'. Therefore, it only remains to analyze indices i £ SAS'. 

Observe that |SAS'| = 2^/n — 2a, and hence that 


Xi = -{l3 — a) + -{2y/n — 2a) > ^((l — 2e)y/n — 1 — a) + -{2y/n — 2a). 

ieSAS' 

Since x* = Xj for i,j £ SAS', for each i £ SAS', one has: 

_ ^ 4 (1 - 2e)Vn - 1 - a 1 

Xi ^ — • -=- — 

“ 5 2y/E-2a 5 

and we want to show that the latter value exceeds xf^ , that is, we would like the following 
inequality to hold 


4 (1 — 2£)^/n — 1 — a 1^1 e 

5 2yAi-2a ^ 5 “ 2 “ 4 


Now notice that 

4 

5 ' 


2y'n — 2 q; 


1 _ n 

4 _ 8 _ 

4 ^ 


H— 

> 

_ — 

5 


2 

— a 

> 



Vs 

C 

-\/n 

> 

cx 


—£ 2vn — 2a 


4 ^ 8 ^ 


and the latter inequality is true since 0 < e < ^ implies that 


4 8 ^ 


1 , . 1 
, p. > - and 4 > -j- 

1 -L ~ 2 1 -L 5 ’ 

4 + 8 ^ ^ 4 + 8 ^ 


5 



therefore, recalling that a < y/nl2 — 4, we get 


as claimed. 


- — —£ 1 

1-1—\/n > > a + 4 > a + 

i + r 2 


i + 


□ 


3 An upper bound for down-monotone polytopes 


In this section we prove Theorem [21 

Let P C M" be a down-monotone polytope. By scaling it, we can suppose that P C [0,1]". 
For any e with 1/2 > e > 0, set 7 := e/(l — e) < 1. We will approximate P with inequalities 
whose coefficients belong to the following set: 


5 := {0} U {[(1 + lY\ : £ = 0,1,..., [log^+z) 
Note that \S\ < 1 + min{[log(;^^:i) and we have 


log(i+i) 


5n 

7 


= O 


/ log(5n/£) 
Vlog(l + I) 


= O 


logn/e 


where the last equality follows from the fact that 
verihed using e.g. rHopital’s rule. We conclude l^l 
|5| = O(logn) for any constant s. 


iog(i+ 2 ) _ 0 ( 1 ) for e ^ 0 , which can be 
= 0 (min{i^^^^f^, 1 ^}), and in particular 


Let now Q be the polytope obtained by intersecting 1 > x > 0 with all the inequalities of 
the form cx < max{c?/ : y € P} with Ci & S for i G [n]. That is: 


Q := {x € M"’ : 0 < x < 1, cx < maxjcy : y £ P} for all c G M"’ with Ci £ SMi £ [n]}. 


In order to prove Theorem |21 we are left to show the following. 
Lemma Q is an e-approximated formulation for P. 

Proof. Clearly P P Q. Consider any vector c G M”. We have to show that 


/? := max{cx : x G P} > (1 — e) max{cx : x G Q}. 

As P is down-monotone, we can assume c > 0. Dehne c as follows. Let K = ||c||oo^ and 

G := {i £ [n] : Ci < K}. Set Cj = 0 for i G G and q = [(1 -t- j Note 

that we have Ci £ S for all i £\n\. 

Let P We now show 

max{cx : X G Q} < max{cx : cx < /3,0 < x < 1} < (1 + 7)/? = /3/(l — e), 


which immediately concludes the proof. The equality follows by definition of 7 . The first 
inequality follows easily by observing that the constraint cx < /3 is a valid constraint for Q, 
as Ci £ S for all i £ [n] and for x G P one has 


^ ^ C2X2 — ^ ^ CiXi 

i i^G 


sE(i + 

i^G 




1 

P 


E 


CfXi 
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For the second inequality, let x* G [0,1]"" be such that cx* > (1 + 'y)f3. We show that 
cx* > /3, concluding the proof. We have: 


cx 


* 


> 


> 

> 

> 


y^^cjx. 

i(^G 


i^G 

2 


2 + j K 


1 


2 + j K 
2 1 


CiX* - Y 
2G[n] i^G 

2 1 


— n 


:CX — 


:Kn — n 


2 + ^ K 2 + ^ K 

2 1 o/. X 2n 

^(1 + 7 ) - - n 


2 + 7 iF 

i}+ ^ 


-/ 3 - 


2 n 


2 + 7 


2+7 2+7 


— n 


/ 3 , 


(2) 


( 3 ) 


( 4 ) 


where (l 2 |) is implied by x* € [0,1]"' and, for i ^ G, 

^ 1 ^ ^ 2)-i _ 1 2 c, 


C,: > 


- 1 : 


2' 2' 2 + 7iF 

l]3|) follows from the fact that c* < iF for i € G, |G| < n, and x* < 1; and (jl|) holds because 

7 2n ~ 4n + yn ^ (4 + 7) ,, ,, 4 + 7 

- (3 — - - n > 0 (3 > -77 /3 > Kn- -= ||c||oo- 


2 + 7 "^ 2+7 - 7 7 H , 

and the latter is true because our choices of parameters imply /? > ||c||oo and 7 < 1 . □ 
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